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Abstract. £/-quantiles are applied in robust statistics, like the Hodges- Lehmann 
estimator of location for example. They have been analyzed in the case of 
independent random variables with the help of a generalized Bahadur repre- 
sentation. Our main aim is to extend these results to [/-quantiles of strongly 
mixing random variables and functionals of absolutely regular sequences. We 
obtain the central limit theorem and the law of the iterated logarithm for U- 
quantiles as straightforward corollaries. Furthermore, we improve the existing 
result for sample quantiles of mixing data. 



1. Introduction 

1.1. Sample Quantiles. The Hodges-Lehmann estimator is defined as H n = 
median | x *+ x i |i <i<j< n| and is an example of a [/-quantile, i.e. a quan- 

tile of the sample (h (Xi, Xj)) 1<:i< j <n , where h is a measurable and symmetric 
function, [/-statistics are decomposed into a linear part and a so-called degenerate 
part, so that the theory for partial sums can be applied to the linear part. Similarly, 
we first improve the existing results for sample quantiles. In a second step, we use 
this to investigate [/-quantiles. 

This article is organized as follows: In the introduction, the definitions and 
some examples are given, the subsequent section contains the main results. In the 
third section, some preliminary results are stated and proved, the proofs of the 
main theorems follow in the last section. Each section is divided into a part about 
sample quantiles and a part about [/-quantiles. 

Let (X n ) neK be a stationary sequence of real- valued random variables with dis- 
tribution function F and p £ (0, 1). Then the p-quantile t p of F is defined as 

t p = F" 1 (p) := inf {f E R\F (t) > t} 

and can be estimated by the empirical p-quantile, i.e. the [^]-th order statistic 
of the sample Xi . . . , X n . This also can be expressed as the p-quantile F^ 1 (p) of 
the empirical distribution function F n (t) := — Y^i=i ^-Xi<t- It is clear that F" 1 (p) 
is greater than t p iff F n (t p ) is smaller than p. In the case of independent random 
variables, this converse behaviour was exploited by Bahadur [3], who established 
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the representation 

(1) F-^ P ) = t p + p - f F ^ ) +R n 

(where / = F' is the derivative of the distribution function) and showed that 
Rn = O ( n~i (log n)5 (log log n)i ) . This was refined by Kiefer [21] to 



limsup — — R n = 2i3 ipi(l-p)^. 

n^oo V 2 log log 71 J 

The following short calculation shows that i? n is related to the (local) empirical 
process (F n (t + t p ) — F n (t p ) — f (t p ) t) t centered in (t p , F n (t p )) and it's inverse 
denoted by Z n : 

Z„ (x) := (F n (• + t p ) - F n (tp))- 1 (x) - 



f(tp) 



mf{s\F n (s + t p )-F n (t p ) <x} 



x 



= inf {s\F n (s) <x + F n (t p )} - - t p 

= F- 1 (x + F n (t p ))-j^—-t p 

So we have 

(2) Z n (p F n (t p )) = F- 1 (p) -t p + Fn f^ P = Rn- 

So the first step of our proof is showing that (F n (t + t p ) — F n (t p ) — f (t p ) t) t€l 
converges to zero at some rate uniformly on intervalls I\ D I2 D I3 . . . By a theorem 
of Vervaat, —Z n has the same limit behaviour as the (local) empirical process. We 
will then conclude that R n = Z n (F (t p ) — F n (t p )) converges to zero at the same 
rate and obtain the central limit theorem and the law of the iterated logarithm as 
easy corollaries. 

There is a broad literature on the Bahadur representation for dependent data 
beginning with Sen |27j . who studied 0-mixing random variables. Babu and Singh 
[2] proved such a representation under an exponentially fast decay of the strong 
mixing coefficients, this was weakened by Yoshihara [34] and Sun [30] to a poly- 
nomial decay of the strong mixing coefficients. Hesse [15J, Wu [32J and Kulik [22J 
established a Bahadur representation for linear processes. The first aim of this 
paper is to give better rates than Sun under polynomial strong mixing. 

Definition 1.1. Let (X n ) ne -^ be a stationary process. Then the strong mixing 
coefficients are defined as 

(3) a(k) := sup {\P[AB] - P[A]P[B]\ : A G jf,Be %,n6 IN} 

where P l a is the a-field generated by random variables X a) . . . ,Xi. We say that 
(X n ) neK is strongly mixing j/lim^oo a(k) = 0. 

For further information on strong mixing and a detailed description of the other 
mixing assumptions, see Bradley [7j. The assumption of strong mixing is very 
common, but does not cover all relevant classes of processes. For linear processes 
with discrete innovations or for data from dynamical systems this condition does 
not hold. Therefore, we will consider functionals of absolutely regular processes: 
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Definition 1.2. Let (X„ 

coefficient is given by 



'new 



be a stationary process. Then the absolute regularity 



(4) 



P{k) = sup SsupflP^J - P[A]\ : A e F™ +k }, 

nSlN 



and (X n ) n€K is called absolutely regular, if /3(fc) — > as fc — > oo. 

We call a sequence (^n)„ gZ a two-sided functional of (Z n ) neZ if there is a 
measurable function defined on E, z such that 

(5) X n = f ((Z n+k ) keZ ) . 

In addition we will assume that (X„) neZ satisfies the 1-approximation condition: 

Definition 1.3. We say that (X n ) n€Z is an 1- approximating functional of (Z„) neZ , 
if 

(6) 

where lim/_ 



E\Xx -E [X a TL^ I < at Z = 0, 1, 2 . 
i ai = and .F_> is t/ie a-field generated by Z_i 



This class of dependent sequences covers data from dynamical systems, which 
are deterministic in the sense that there exists a map T such that X n+ \ = T (X n ). 
For example, the map T (x) = - — |_ -\ is related to the continued fraction 



X n 



f {(Zn+k) 



1 



ken) 



Z„ 



i 



where (Z n ) n&K is a stationary, absolutely regular process (even uniformly mixing, 
see Billingsley [5], p. 50) taking values in IN if the distribution of Xq is the Gauss 
measure given by the density / (x) = i^-j jtpj- 

Linear processes (where the innovations are allowed to be discrete and depen- 
dent) are also functionals of absolutely regular processes. Let (2 Il ) rigZ be a station- 
ary, absolutely regular process with E \Z\\ < 00 and (cfc) fegK a real valued sequence 
with J^'kLi \ c k\ < 00 ■ Then for X n = J^'kLi 



E\Xi- ElXi^lj]] =E 



J2 c k (Z l - k -E[Z 1 - k \F l _ l ]) 



k=l+l 



< 



00 

£ 

k=l+l 



c k \2E\Z 1 \ =: ai 



J ->0. 



The second aim of this paper is to establish a Bahadur representation for func- 
tionals of absolutely regular processes. If (X n ) neZ is an approximating function 
with constants (az) ig]N , it is not clear that the same holds for (g (X n )) neK . We 
therefore need an additional continuity condition: 

Definition 1.4. Let (-^n)„gjsf be a stationary process. 

(1) A function g : E, — > R satisfies the variation condition, if there is a constant 
L such that 



(7) 



E 



sup \g{x)-g{x')\ 

c — Xq 1 1 < e , 1 1 x ' — Xq 1 1 < e 



< Le. 
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(2) A junction j : t x E 4 t satisfies the uniform variation condition on 
B C M, if there is a constant L such that Line holds for all functions 
g(;t),t€B. 

Obviously, every Lipschitz-continuous function satisfies this condition, but our 
main example are indicator functions. However, the variation condition can also 
hold for such discontinuous functions: 



Example 1.5. Let g(x,t) = t{ x<t y Then 
sup \g(x,t) - g(x',t)\ 

\\x-X n \\<c, \\x'-X \\<e 

Hence 



E 



sup \g(x,t) - g(x',t)\ 

\x—Xq\\<€, 1 1 a:'— Xq II <e 



1 \iX e(t-e,t + e] 
else 



< F (t + e) - F {t - e) < Le 



uniformly on R, if F is Lipschitz-continuous. 

1.2. t/-Quantiles. U-quantiles are applied in robust estimation, for example the 
Hodges-Lehmann estimator of location. It has a breakdown point of 29%, that 
means 29% of the random variables can be replaced by random variables with 
different distribution before the estimation breaks down completely (see Huber [18] 
for details). It is also very efficient in the case of independent normal distributed 
random variables. 

Let /i : ]R x R, — > R be a measurable, symmetric function. We are interested in the 

which 



empirical [/-quantile, i.e. the p-quantile of the sample (h (Xi, Xj)) 1 
can be expressed by U~ x (p) with U n (t) := 



<i<j<n ' 



n[n — 1) 



12l<i<j<n 1 h(Xi,Xj)<t- Let 



U (t) :— P[h (X, Y) <t] (X,Y being independent random variables with the same 
distribution as X x ) be differentiable in U^ 1 (p) with u (U^ 1 (p)) := U' (U^ 1 (p)) > 
0. Similarly to a sample quantile, (p) can be analyzed with the help of a 
generalized Bahadur respresentation 



(8) 



u- 1 (p) = u- 1 (p) + 



u (u- 1 (p)) - u n (u- 1 (p)) 



u(U-i(p)) 

For the special case of the Hodges-Lehmann estimator of independent data, 
Geertsema [14J established a generalized Bahadur representation with R' n = O (n~^ log 
a.s.. For general ?7-quantiles, Dehling, Denker, Philipp [10 and Choudhury and Ser- 
fiing [8] improved the rate to R' n = O (log n)i^J . Arcones [lj proved the exact 

order R' n = O (n~i (log log rt) as for sample quantiles. We use a slightly more 
general definition: 

Definition 1.6. We call a nonnegative, measurable function h : M, x R x R — > 
R, which is symmetric in the first two arguments and nondecreasing in the third 
argument, a kernel function. For fixed t G R, we call 



(9) 



U n (t) 



n(n- 1) i 



E 

<'i<j <n 



h(Xi,Xj,t) 



BAHADUR REPRESENTATION FOR (7-QUANTILES 



5 



the U -statistic with kernel h{-,-,t) and the process (U n (t)) te ^ the empirical U- 
distribution function. We define the U -distribution function as U (t) := E [h (X, Y, t)], 
where X, Y are independent with the same distribution as X\. 
U^ 1 (p) is called empirical p-U -quantile. 

In order to prove asymptotic normality, Hoeffding [TH] decomposed [/-statistics 
into a linear and a so-called degenerate part: 

2 - 2 

(10) U n (t) = U(t) + -y^h 1 (X t ,t) + — V h a (X i ,X j ,t) 

n n(n— 1) ' 

i=l v ; l<i<j<n 

where 

h x {x,t) := Eh{x,Y,t) -U(t) 
h 2 (x,y,t) := h(x,y,t) - hi(x,t) - hi(y,t) - U (t) . 

[/-statistics and [/-processes have been investigated not only for independent 
data, but also for different classes of dependent data: Sen (28] considered ★-mixing 
observations, Yoshihara [33] studied absolutely regular observations, Denker and 
Keller [13j functionals of absolutely regular processes. Borovkova, Burton, Dehling 
[6 J extended this to [/-processes. Hsing, Wu [12] investigated [/-statistics for some 
class of causal processes and Dehling, Wendler [11], [12] for strongly mixing oberser- 
vations. As far as we know there are no results on [/-quantiles of dependent data, 
our third and main aim is to give a rate of convergence of the remainder term in 
the Bahahdur-representation of [/-quantiles for strongly mixing sequences and for 
functionals of absolutely regular sequences. The central limit theorem and the law 
of the iterated logarithm for [/-quantiles are straightforward corollaries. 

Similar to sample quantiles, we need special continuity assumptions on the kernel: 

Definition 1.7. Let (X n ) neW be a stationary process and f £ E. 

(1) The kernel h satisfies the variation condition for t G R, if there is a constant 
L such that 



(11) E 



sup \h(x,y,t) - h(x',y',t)\ 

\(x,y)-(X,Y)\\<e, \\(x> ,y')-(X,Y)\\<e 



< Le, 



where X , Y are independent with the same distribution as X\ and \ \ (x%, X2)\\ : 
{x\ + x\) x ^ 2 denotes the Euclidean norm. 
(2) The kernel h satisfies the uniform variation condition on B C R, if there 
is a constant L such that Line ill]) holds for all t G B. 

Example 1.8 (Hodges-Lehmann estimator). Let h(x,y,t) = ^-^i^ x+y ^ <t y The 
0.5-f7-quantil is the Hodges-Lehmann estimator for location [IT]. Note that 



sup 

\\(x,y)-(X,Y)\\<c 
\\(x',y')-(X,Y)\\<< 



1 {l( x+ y)<t\ 1 {±(x>+y>)<t} 




| if g t - — t + — 
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If X\ has a bounded density, then the density fi/ x +Y) of ^ (X + Y) is also bounded, 



E 



sup \h(x,y) - h(x',y')\ 

\(x,y)-(X,Y)\\<e, \\(x',y')-(X,Y)\\<e 



< P 



X+Y ( e e 



< ( V2 sup fx 



(X+Y) 



(X) 



and 1 r w . n^.i satisfies the uniform variation condition on R. 

Example 1.9 (Q n estimator of scale). Let h (x, y, t) = ^{\x-y\<t}- When the 0.25- 
[/-quantile is the Q n estimator of scale proposed by Rousseeuw and Croux [26]. If 
X\ has a bounded density, then with similar arguments as for the Hodges-Lehmann- 
estimator, l{i x _yi<t} satisfies the uniform variation condition. 

2. Main results 

2.1. Sample Quantiles. In the following theorems we assume that (X n ) n( - m is a 
stationary process. 

Theorem 1. Let j : Ex R - > M be a nonnegative, bounded, measurable func- 
tion which is nondecreasing in the second argument, let F (t) := E [g (X\, t)] be 
differ entiable in t p € R with F' (t p ) = f (t p ) > and 

(12) \F(t)-F(t p )-f(tp)(t-t p )\ =o(\t-t p \^ as t^t p . 

Assume that one of the following two conditions holds: 

(1) (X n ) neW is strongly mixing with a(n) = O [n~ ) for some j3 > 3. Let 
7 ■ ■ 

(2) (X n ) n( -j^ is an I -approximating functional of an absolutely regular process 
(Z n ) neZ with mixing coefficients (/3(n)) n( - K and approximation constants 
(a„) nG]N; such that j3{n) — (n~P) and a n = (n~(' 3+3 )) for some (3 > 3. Let 
g satisfy the variation condition uniformly in some neighbourhood oft p and 

Then for F n (t) := — J^? 1 g (Xi, t), p — F (t p ) and any constant C > 
(13) 



sup 



\F, 



\t-t P \<c^p- 
(14) 



'„ (t) -F{t)- F n (t p ) + F {t p )\ = o (n-f-^(logn)* (log log n)*) 



R n := F- 1 (p) - tf 



F jt p ) ~ F n (t p ) 
f(t P ) 



= o(n 8 8 7 (log n) 4 (log log n) - 



a.s. as n — y oo . 

Remark 1. Bahadur representations for sample quantiles of strongly mixing data 
have previously been established by Yoshihara [34] and Sun [30]. Yoshihara states 

the rate R n = o (^n~i logn^j a.s., but a careful reading shows that there is a mistake 

in Line (20) of his paper, which has to be 



E 



n I 
3=1 i=l 



< n 2 (lq k ) 1+ \ 
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rate R n = o (n i +s log nj for any S > 



4(/3+i) • 



Remark 2. Our condition in Line (fT2"]l is fullfilled if F is twice differentiable in 
t p . This is weaker than F being twice differentiable in a neighbourhood of t v as 
required by Bahadur [5], Yoshihara [33] and Sun |30| . 

Corollary 1. Under the assumptions of Theorem]]] it holds that 

(15) ^{F- 1 {p)-t p )^N(0 1 a 2 ) 
wh 



ere 



II 



fe=2 



Under Condition 1. a.s. 



(16) limsupi^ j-^— (F„- (p) - t p ) = V2. 2 . 

Under Condition 2., the sequence log ^ g ?t ~ (F~ 1 (p) — t p ) is a.s. bounded. 

Proof. This Corollary follows directly by the central limit theorem for F n (t p ) (The- 
orem 1.4 of Ibragimov [20], Theorem 4 of Borovkova et al. [6J) respectively the law 
of the iterated logarithm (Theorem 3 of Rio [25J, Proposition 13. 7p . the Bahadur 
representation ([T]) and Line (fT4"|) . □ 

2.2. J7-Quantiles. 

Theorem 2. Let /i:MxlxE->R6ea bounded kernel function that satisfies the 
uniform variation condition in some neighbourhood oft p . Let U (t) :— E [h (X, Y, t)] 
be differentiable in t p £ 1R with U' (t p ) = u (t p ) > and 

(17) \U(t)-U(t p )-u(t p )(t-t p )\=o(\t-t p \^ as t-ttp. 

Assume that one of the following two conditions holds: 

(1) ||X n ||j < 00 and {X n ) n€N is strongly mixing and the mixing coefficients 
satisfy a (n) — O {n^ 13 ) for some fj > Le 7 := ■ 

(2) (X n ) ne ^ is an 1- approximating functional of an absolutely regular process 
{Z n ) ne % with mixing coefficients (/3{n)) n€rj and approximation constants 
(a„) ng]N; such that (3(n) = (n~ ^) and a n — (n~^ +3 )) for some (3 > 3. Let 

1 ■ /3+i ' 

Then for U n (t) := „ (Tt 2 „ 1) Ekk^x^^'^J'^' P = U (*p) arld ar ^ constant 

C>0 

(18) 

sup |C/„ (t) - 17 (t) - (7„ (t p ) + C/(< p )| = (n-*-*T(]ogn)*0og]ogn)*) 

| t _ tp |< C% /i°&i£&ii 



(19) < := [7- 1 (p) - t p + ^ (fp) M( ^" (fp) = « (n-*-^(logn)i(loglogn)*) 

.s. as n — > 00. 
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Corollary 2. Under the assumptions of Theorem^ it holds that 
(20) K 1 (P) - t P ) ^N(0,a 2 ) 



with 



a 2 = 



Pit 



l — I Var [h! (Xt, t p )\ + 2 V Cov [hi {X lt t p ) , h x (X k ,t p )} 
[t P ) V k=2 



Under Condition 1. a.s. 



(21 ) li msup±A /___ (C/ -i (p) _ g = V2a2. 



Under Condition 2., the sequence \ og \ of ^ (U n 1 (p) — t p ) is bounded a.s. 

Proof. This Corollary is an easy consequence of Line (fT!?)) and Proposition 13.131 
respectively Proposition 13.111 or 13.121 

□ 

3. Preliminary results 

3.1. Sample Quantiles. In this section, we recall some existing lemmas for handy 
reference and prove some technical results. In the proofs, C denotes an arbitrary 
constant, which may have different values from line to line and may depend on 
several other values, but not on n £ IN. An important tool in the analysis of weakly 
dependent random variables are covariance inequalities: 

Lemma 3.1 (Davydov |9j). If Y\ and Y 2 are random variables such that Yj is 
measurable with resprect to T\ and Y 2 with respect to -F£^„ for some k £ IN, then 

\E [Y1Y2] — E [Yi] E [F 2 ]| < lOplI^ \\Y 2 \\ p2 a^ (n) 
for all Pl ,p 2 ,p 3 e [0,1] with JL + JL + i = 1. 

Lemma 3.2 (Borovkova et al. [6]). Let (X n ) neri be an I -approximating functional 
with approximation constants (a;);g]N °f an absolutely regular process (Z n ) ners and 
I l-^o 1 1 9+5 < 00 f or some S > 0. Then 

s 

f f h \ \ 2 + 6 2 + 5 s 

2 I R I I _ I II _L A II V„ll !+ 4 n '+f 



I £ [M +fe ] (£X, ) I < 2 1 1 X 1 1 < 2+s \B {I - J J J + 4 \\X 1 1 a f+j 

Lemma 3.3 (Borovkova et al. [6j). Le£ (X n ) ngB fee a bounded I -approximation 
functional with approximation constants (a;)/eiN °/ 071 absolutely regular process 
(^n)„ e w T/len 



< ( 6 \\X \\l +s h ( L^j ) ) " + 8 UXolllg ) ||X ||L 



and 



< 6 ||jro||^ +a h M^ 2 M J + 8 ||X ||J8 aj^j HXoIlL 



BAHADUR REPRESENTATION FOR (7-QUANTILES 







In the analysis of empirical processes, fourth moment inequalities are often used: 

Lemma 3.4. Let (X n ) neK be a stationary, strongly mixing sequence with a (n) = 
O (n-P) for some f3 > 3 and C\,Ci > constants. Then there exists a constant 
C , such that for all measurable, nonnegative functions g : K, — > 1R, bounded by C\ 
and with E \g (Xi) - Eg (Xi)\ > C 2 n T*+* and all n E IN 

4 



E ( J^g (X,) - E [g (X,)} < Cn 2 (logn) 2 (E \g (X 1 )\) 



1+7 



with 7 = ^-g- 2 - . 

Proof. We define the random variables Yi — g (Xi) — Eg(Xi). Using Lemma [3.11 
with pi — p2 — ^3 and p% = ^ we obtain the following three inequalities for all 

i,j,k€ IN: 

lEiYoYiYi+jYi+j+k]] < CaJ (i) ||y ||_^_ ||y ^^+fc|| w_ , 
\E[Y YY i+j Y i+j+k }\ < C\E [Y Yi] \ \E [Y Y k ]\ + CoJ (J) ||F ^||^_ 11*0^11^ , 
\E[Y Y t Y l+] Y l+]+k ]\ < Ca% (k) \\Y YiY i+j \\ ^_ \\Y a \\^_ 



By the same lemma with p\ = p 2 = -3zj ancl P3 — /3, we get 



\E\Y Yi]\<Ca* W||>i|| 2 ^_. 

As Y n is bounded, we have that ||ln|| < C(E\Y 1 \) S ^, \\Y YjYj +k \\i§_ < 
CiElYxl)^, HYill 2d < C{E\Y 1 \) e ^ and it follows that 

1 1 2,3-2 3 g-3 

\E[Y YiY i+j Y i+j+k ]\ < Ca? (i)a? (k) (E \Yi\)e~ +Ca~$ (max{i, j, k}) (E \Y X \) V" 
Now by stationarity it is 

5^>i <Cn £ |£[r y i y i+fc y m+J -]| 

i=l / i,j,k=l 

n n n 

< Cn 2 J2 a ^ WE a ^ ( k ) (ElYil)^ +CnJ2 i2 ^ (*) ■ 

j=l fc=i i=l 

fl g-3 2,3-2 

As J5|5(Xi)| > C 2 n-Jn, we have that (£'|Yi|)~ < Cn (SlFiQ^ - and with 
a (n) = O ( n ^) > we arrive at 

i=l / i=l fe=l i=l 

< Cn 2 (logn) 2 (£|Yi|)^ = Cn 2 (logn) 2 (E |YiJ) 1+7 . 



□ 

If (X„) ne in is an 1-approximating functional and g an arbitrary function, it is 
not clear that the same holds for (g(X n )) n ^, so we give the following lemma: 
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Lemma 3.5. Let (X n ) neK be an 1- approximating functional of an absolutely reg- 
ular process {Z n ) neZ with approximation constants (a n ) nerl and let g be a func- 
tion bounded by K and satisfy the variation condition with constant L. Then 
(g (-^n)) n gfj * s an 1" approximating functional with approximation constants ((L + K)^Onj ^. 



Proof. By the Markov inequality we have that 
P [\X Q - EiXolTL^ >^al\< 

We conclude that 

E[g (X ) - g (E[X \jt t ])] 



E \X Q - EiXolT^l 



< y/ai- 



--E 



(g (Xo) - g (E[X \J±{\)) ^ {Xo - e^I^} 



sup \g{x)-g(x')\ 

-X ||<yo7, \\x'-X \\<y/ai 



<E 



KP [X a - E[X a \FU] > V5T| 



□ 



Lemma 3.6. Let {X n ) neK be an 1- approximating functional of an absolutely reg- 
ular process (Z n ) ne z with mixing coefficients (3(n) = O (n - ^) for a f3 > 3 and 
approximation constants a n = O (n~(' 3+3 - ) ). Let Ci,C2,L > be constants. Then 
there exists a constant C , such that for all measurable, nonnegative functions g : 

R — > R that are bounded by C\ with E \g (Xx) — Eg (Xi)\ > Cin ' 3 + 1 and satisfy 
the variation condition with constant L, and all n G IN we have 



E[J29 (Xi) -E[g {X,)] < Cn 2 (logn) 2 (E \Yx\) 



1+7 



\i=l / 

with 7 = . 

Proof. We define the random variables Yi = g (Xi ) — Eg (X\ ) . Then by Lemma 
13.51 (Y n ) neK is an 1-approximating functional with approximation constants a n = 

(L + Ci)y/a^ = O (n • Using Lemma 15731 with S - we obtain 



\EYoYiYi + jYi + j + k I 

max {i, j, k} 



<C[P*[[ 



J ]||F ||V +a L 



2/i 

:{i,j,k} , II^OH 20 
~3 J 



\E [Y Y] E [Y Y k ] 



Making use of Lemma 13.21 and 8 — -g^j , it follows that 



\EY YY i+j Y i+j+k \ <C[/3 



max {i,j,k} \ 2 

L O J ) ll^ll^j + a 



L- 



2/3 
>' < » I I ■ 



|Fn|r +3 
9^3 



+C[07[ £J ) 11^0% +a[t] \\Y \ 



2<3 
3 + 1 
23 
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First note that 

(3TJ ( n ) = O (n- 1 ) , a^=0{rT 1 ) 
pi (n) = O (n- 3 ) , h = o ( n - 3 ) 

and that 

b||V<c||y ||# <c\\Y a \\f£, 



2ft 0-3 2/3-2 

ll^ollk < enroll % 3 <c\\Y Q \\r <Cn\\Y \\7^ 



g 

as > Cin . Now by stationarity 



E E y * - Cn E |s[r r t y t+ ,y s:+J+fe ] 

\i=l / i,j,k=l 



n / . \ n / I \ 2/3-2 " 2 " 2 2/3-2 

<cn a x;^(Ljj)E^(Lfj)riiii' v " +^ 2 E s SIE s 5]i^iii 

i=l ^ ' k=l ^ ' i=l 3 fe=0 3 

+ Cn E ™ 2 /^ (L jj) INlf^ + C?n E ™ 2 «(fj ll^ollF 

m— 1 m— 1 

** ** 2,3 2 2/3 — 2 

< C " 2 E rl E rl lliill^ +Cn 2 ^ m 2 m- s HUH^ 

2—1 k—1 rn — 1 

<Cn 2 (logn) 2 (S|Yi|)¥^ = Cn 2 (logn) 2 (£ |Yi|) 1+7 



□ 

We use the representation R n = Z n (F (t p ) — F n (t p )), so we have to know the 
a.s. asymptotic behaviour of F n (t p ) — F (t p ). The law of the iterated logarithm 
for functionals of mixing data has been proved by Reznik |24| . We only prove that 



n) a.s. 



io°. ^ g - (F n (t p ) — F (t p )) is bounded a.s., but under somewhat milder conditions, 
which fit better to our theorems: 

Proposition 3.7. Let (X n ) nerl be a bounded, 1- approximating functional with ap- 
proximation constants a n — O {n~P) for some j3 > 3 of an absolutely regular process 
(•^n)n£]N with mixing coefficients (3 (n) = O (n^^. Then 

n 

(22) E ( x * - EX i) = (V« log log 

i=l 

Proof. W.l.o.g. we assume that EXi = 0. We use a blocking technique and define 

k 

Bin = J]] X (i-l)k+j 
3=1 

for i = 1, . . . , L|J with k = k n = LiffjJ for 2 l < n < 2 l+1 and write 

n n 

E^ = E E + E x <- 

i=i s<L^J s<L^J tfcL^j+i 

s odd s evcn 
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By Lemma 2.24 of Borovkova et al. [BJ, we have that for all N, m € IN 

4 

< Cm 2 



E A 

i=N+l / 



and by Corollary 1 of Moricz [23] that 







max 


E * 


I l<m<k 




»=fcLfJ+i 



< Ck 2 . 



It follows that 



E I max 

2 1 <n<2 1 + 1 



E * 

j=fcL£J+i 



< — i? max 

fc I Km<fc 



fe Lf J+ m 

E * 

i=feLfJ+l 



So we get for every e > 

oo 

E^ 



i=0 





n 




max 


E * 


> 25 e 


2'<n<2' + 1 






l= fcL£J+l 





^E^r^ 

i=0 





n 


max 


E * 


\ 2<<n<2 l + 1 




j=fcLf J+i 



C 2«'logZ 
<~2^ ^ <oo 



z=o 



and by a applying the Borel-Cantelli lemma we conclude that Yld= 
o(y/n) a.s. By Theorem 3 of Borovkova et al. [BJ, there exists a sequence of 
independent random variables {B' sn ) sG - N , such that for all even s 



P 



\B m -B' sn \<2A 



> 1 



2A Yi\ "%J 



with A L = v / 2J2Zl a i = ° [L- {1+tL ^ ) ) . It follows that 



P 



sup 



™<Ltt-J l<s<m 



^ \ B sn - B' sn \ > 2 ^^L|J 



2 l+1 / \ 



2 i+1 -3,, 



k 2+L 



< C2~— '(log/)— 



Note that — > as ?i — > oo so that 



E^ 

i=i 



sup 

2 i <n<2 i + 1 



E Bsn ~ 



*<L£J 

s even 



> e 



2-'— (log/)— < oo 



and it follows hat X)s<L-J (Bsn ~ B' sn ) = o(l) a.s. The same arguments justify 

s even 

that there exists sequences [B" m ^j , such that 53s<LfJ (^sn — B" n ) — o(l), so 



s odd 
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it suffices to show that 



1 



y/n log log n 



E B '™ 



«<LtJ 

s even 



< c 



a.s. (the sequences (B") can be treated in the same way). By Lemma 2.23 of 
Borovkova et al. [5] , we have that 

Var [B' sn ] < Ck 

and 

J2 YBx[B' sn ]<Cn 

s <LfJ 

s even 

and additionally |-Bg n | < Ck. So by Bernstein's inequality (see Bennett [3]), we 
obtain for all N < [f J , 2 l < n< 2 l+1 and C\ > 



P 



E K 

Ar< s < L 2<!±i)j 



> C 1 y/¥hgl 



civ log i 



< 2e - 2 EVar[Bj Il ]+2Civ / 2 ! logiys^ 



Of 2 1 log 1 



< 2e c2i'+ 1 )+cc 1 V2 1 iogU27 iog-i ij < 2l~~& . 



Due to Skorohod's inequality (see Shorack, Wellner p. 844), we conclude that 



(23) 



P 



sup 

2 ! <n<2 ! + 1 



s <LiJ 



B' 



> 2Ci n log log 1 



< 



2r-cf 



Choosing the constant C\ large enough, the probabilities in Line 
and 



are summable 



1 



\J n log log n 

for almost all n G IN a.s. follows by the Borel-Cantelli lemma. 



E 

«<LiJ 

s even 



B' 



< 2d 



□ 



3.2. U-Quantiles. [/-statistics can be decomposed into a linear and a degenerate 
part, which is a U -statistic with kernel h 2 (x, y,t) := h(x, y, t) — h\ (x, t) — hi (y, t) — 
U (t). If h is bounded and satisfies the variation condition in t, the same holds for 
hi, see Lemma 4.5 of Dehling, Wendler |12j. Furthermore, hi is degenerate, i.e. 
for all y, t G M : Ehi (Xi,y,t) = 0. For the degenerate part, we need generalized 
covariance inequalities. 

Lemma 3.8. Let (X n ) nerl be a stationary, strongly mixing sequence with WXn^ < 
oo ; ft,:lR,xlR,x]R— >Ra bounded kernel function that satisfies the variation 
condition in t. Then there is a constant, such that 



where m 



< i(2) < «(3) < Hi)- 



\E\h 2 (X n ,X l2 ,t) h 2 (X i3 ,X u ,t)]\ < Ca* (m), 

; {«(2) - i(l),*(4) - *(3)}, {h,h,h,h} = {i(l),i(2)j*(3)>*(4)} 
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Proof. The result is easily obtained by taking the limit 8 — > oo in Lemma 4.2 of 
Dehling, Wendler pj]. □ 

Lemma 3.9. Let (X n ) neK be an I -approximating functional with approximation 
constants (a n ) n&rl of an absolutely regular process with mixing coefficients (/5(A:)) fcg]N . 
Let h{-,-,t) : Rx K , — > M be a bounded kernel function that satisfies the variation 
conditon in t. Then 

\E [h 2 (X h , X l2 , t) h 2 (X l3 , X u ,t)]\<C {J3( LyJ ) + A^J ) 
with A L = ^/2J2^L L ai- 

Proof. The result is easily obtained by taking the limit S — > oo in Lemma 4.3 of 
Dehling, Wendler [12]. □ 

Lemma 3.10. // a kernel function ft:ExExR->E satisfies the variation 
condition in t with constant L, then the variation condition holds for h\{-,t) with 
the same constant L. 

Proof. Let be Y independent of X with the same distribution as X. Then 



E 



sup \hi (x, t) — hi (a;', t)\ 

\\x-X\\<e, \\x'-X\\<( 



E sup \Eh(x,Y,t) - Eh(x',Y,t)\ 

\x-X\\<e. \\x'-X\\<e 



<E sup \h(x,Y,t) -h(x',Y,t)\ 

c-X\\<t. \\x'-X\\<e 



< E 



sup \h(x,y,t) - h(x ,y ,t)\ 

\(x,y)-(X,Y)\\<e, \\(x> ,y>)-(X,Y)\\<e 



< Le. 



□ 



The law of the iterated logarithm for {/-statistics has been investigated by 
Dehling, Wendler [T2], but here we state it under slightly different conditions: 

Proposition 3.11. Let (X n ) neK be a stationary, strongly mixing sequence with 
WXnW-^ < oo, /i:RxHxR— >Ha bounded kernel function which satisfies the 
variation condition in t. If the mixing coefficients satisfy a (n) — O (n^^) for some 
/3 > 2, then a.s. 



(24) 



lim sup ± 



log log n 



U n (t) = J2af 



with g\ = Var [h! (X lt t)] + 2 J2T=2 Cov [hi (Xi,t) , h x (X k , t)}. 

Proof. The proof is the same as the proof of Theorem 2 of Dehling, Wendler [T^] , 
where Lemma [5751 plaves the role of Lemma 4.2 of Dehling, Wendler [12], and hence 
omitted. □ 

For functionals of absolutely regular sequences, we give not the full law of the 
iterated logarithm, only a weaker version under much milder conditions than in 
Dehling, Wendler [12]. 
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Proposition 3.12. Let (X n ) be an 1- approximating junctional with approximation 
constants a n = O (n~^ +3 ^ for some /3 > 3 of an absolutely regular process (Zn) ne % 
with mixing coefficients (i(n) = O Let ft : ExExffi,- > M, be a bounded 

kernel function which satisfies the varitation condition in t. Then 



(25) (U n (t) - EU n (t)) = O 



Proof. We use the Hoeffding decomposition 



' log log n 



2 2 

U n (t) - EU n {t) = -Y hi {X h t) + — y h 2 (X u Xj,t) . 

n z — ' n(n— 1} L — ' 

i=l v 1 l<i<j<n 



Note that hi satsifies the 1-approximation condition in t by Lemma 13.101 and by 
Lemma [3.51 (hi (X n ,t)) nefi is an 1-approximating functional of (Z n ) n( - Z with ap- 
proximation constants Cy/a^ = O (n~^i~ J , so by Proposition 13.71 



2 i / ~\ r \ ^ I log log n \ 



n 

i=l 



With Lemma 13.91 replacing Lemma 4.3 of Dehling, Wendler [T2] we can prove in 
similarly to Theorem 1 of Dehling, Wendler [T2] that 

-* £ h2 (X i ,X j ,t) = o( ^ l °^ n ) 
n(n— 1 e -^ 1 \ n 

a.s., which completes the proof. □ 

Borovkova et al. [6] and Dehling, Wendler [TT] have established the central 
limit theorem for [/-statistics under p-continuity, which is a similar assumption to 
the variation condition. The central limit theorem still holds under the variation 
condition: 

Proposition 3.13. Let /i:RxExR->E be a bounded kernel function that sat- 
isfies the variation condition in t and let one of the following two mixing conditions 
hold: 

(1) Let (X n ) neK be a strongly mixing sequence with E\Xi\ < oo, and a(n) — 
O (n-P) for a 13 > 2. 

(2) Let (X n ) be a 1-approximating functional with approximation constants 
a n = O (n~(P~^ 3 n for some (3 > 3 of an absolutely regular process (2 n ) n£Z 
with mixing coefficients /3(n) = O (n -19 ). 

Then 

(26) Vn~ {Un (*) - U(t)) A N (0, a\) 

with 

oo 

o\ = Var [hi (X lf t)] + 2 £ Cov [hi{X u t),hi {X k , t)] , 

k=2 

Proof. Under Condition 1. the proof is the same as for Theorem 1.8 of Dehling, 
Wendler [TT] with our Lemma replacing their Lemma 3.3. Under Condition 2., 
we replace Lemma 4.3 of Borovkova et al. [B] by our Lemma [3.91 in the proof of 
their Theorem 7. □ 
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4. Proof of Main results 

4.1. Sample Quantiles. In the proofs, C denotes an arbitrary constant, which 
may have different values from line to line and may depend on several other values, 
but not on n € IN. 



Proof of Theorem QJ Let c„ 



r (log n) * (log log n) 2 . We first prove that 



1=0 



max — sup (F n (t)- F n (t p )- F(t) + F(t p ))> e 



oo 1 



l=0 C 2' 



\ 



max sup (F n (t) - F n (t p ) - F (t) + F (t p )) 



< oo. 



Line (fl"3f will follow by the Borel-Cantelli lemma. We set d 2 i — i^r) an d 
d n = d 2 i for 2 l <n< 2 l+1 . Let fc G Z. As F n , F are nondecreasing in t, we have 
for any t G [i p + fc<i n , i p + (fc + l)d n ] that 

|K (*) - (t p ) -F(t) + F(t p )\ 

< max{|F„ (t p + kd n ) - F n (t p ) - F (t) + F (t p )\ , 

\F n (t p + (k + l)d n ) - F n (t p ) - F (t p ) + F (t p )\} 

< max{|F„ (t p + kd n ) - F n (t p ) — F(t p + kd n ) + F (t p )\ , 

\F n (t p + (k + l)d n ) - F n (t p ) -F(t p + (k+ l)d n ) + F (t p )\} 
+ \F (t p + (k + l)d n ) -F(t p + kd n )\ . 

It follows that 



sup (F n (t) — F n (t p ) — F (t) + F (tp)) 
\t-t P \<c/^ 

< max i (F n (t p + d n k) ~ F n (t p ) - F (t p + d n k) + F (t p )) 

|fe|<C(2' logi)' 

+ max JF (tp + (k + l)d n ) - F (t p + kd n )\ . 

|fc|<C(2 ! log/)i 

From condition (fT2ll. we conclude that 



max i |F (t p + (k + l)d„) — F (t p + kd n )\ < f(t p )d n +o 

|fe|<C(2 ! \ogl)i 



logZ 
2 l 



= o(c n ) 



Furthermore, we have that for all k±, k 2 < C (2 l log?) ' 



\F{t p + d n ki)-F{t p + d n k a )\ = f{tp)\k 1 -k 2 \d n +o\d-^- <C\h-k 2 



log? 
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So by Lemma 13.41 (under mixing Condition 1.) or Lemma 13.61 (under mixing Con- 
dition 2.) 

E (F n (t p + d n k x ) - F„ (t p + d n k 2 ) -F(t p + d n h) + F{t p + d n k 2 )f 



1 



<C^ (logn) 2 |fei-A;2| 1+7 dl+\ 

Note that we can represent the differences of the empirical distribution function as 
a double sum 

F n (tp + d n k) - F n (t p ) -F(t p + d n k) + F (t p ) 

n k 

= ^ X *> *p + jdn ^ ~ tp + (j - l)dn) - F(t p + jd n ) + F(t p + (j - l)d n )) , 

i=i j=i 

so by Corollary 1 of Moricz [23J , it then follows that 

/ \ 4 



c. 



X —E \ ni max i ^ max i (F n (t p + d n k) - F n (t p ) — F (t p + d n k) + F (t p )) 



v V 2! -™ <2!+1 W<c '(a« log 



c 2 i 



< C^E F n t p + cJ 1 ^^ - F n L - C X / l0gl ° g " 



-F\tp + cJ 1 ^^ )+F tp-cJ l0ghSn 



P(log0 2 2 2i 2^ Z(log0 



3-3 



As 7 < 1, this quantities are summable and Line (|13|) is proved. 

To prove Line (|14p . let w.l.o.g. / (t p ) = 1, otherwise replace g (x, t) by g (x, j^jj ■ 
We represent R n as Z„ (F (t p ) — F n (t p )) with 

Z n (x) := (F„ (• + t p ) - F„ (tp))" 1 (x)-x = F- 1 (x + F n (t p )) - x - t p . 
By Theorem 3 of Rio [55] respectively Proposition 13.71 a. s. 

limsupi./^ (F n (t p ) -F(t p )) < C. 

n-Hx> V log log n 

By Line and Condition (TE 



sup \F n (x + t p ) - F n (tp) - x\ 

\x\<C'y/ loel ° en 

sup \F n (X + t p ) - F (X + t p ) - F n (t p ) + F (t p 

\x\<C'y/ loel ° en 

+ sup \F (x + tp) — F (t p ) — x\ = o (c n ) a.s. 
|z|<cy logl ° s " " 
Then by Theorem 1 of Vervaat [31 

SUp \Z n (x)\ = o(c n ) a.S., 

\x\<Cy/ losl ° en 
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(Vervaats theorem is for random functions from [0,oo) to [0, oo), but it becomes 

clear from the proof of his Lemma 1 that it also holds for the intervalls [— C^J~ ^ l ° sn , C \J ' l °s l ° &E]) m 

Hence R n = Z n (F (t p ) - F n (t p )) = o (c„) a.s. □ 

4.2. [/-Quantiles. 

Proof of Theorem [H To prove Line (|18p , we use the Hocffding decomposition 

U n (t) = U{t) + -f2h 1 (X i ,t)+ 2 V h 2 (X i ,X j ,t). 
n t— i n(n — 1) ' 

As above, we set c n — n - *^ - ^ 7 (logn)^ (log log n) 5 and d n — ^ lo s ^ s " ^ 4 and get 

sup \U n (t) - U n (t p ) -U(t) + U (t p )\ 
\t-t P \<c/^l 

< max i \U n (t p + d n k) - U n (t p ) - U (t p + d n k) + U (t p )\ 

|fe|<C(2 1 logi)3 

+ max \U (t p + d n (k + 1)) - U (t p + d n k)\ 

\k\<C(2 l log!)' 



and 



max \U (t p + d n (k + 1)) - U (t p + d n k)\ = o(c n ) . 
\k\<c{2' io g ;)i 



By Lemma 13.101 we have that hi satisfies the variation condition uniformly in 
some neighbourhood of t p . Applying Theorem [T] to the function g = hi, we obtain 



max 

\k\<C(2> logi)i 



2 n 2 n 

hi (Xi,t p + kd n ) - - ^hi (X u t p ) ~U(t p + d n k) + U (t p 



n '■ — ' n 

i=l i=l 



= o(c n ) 

a.s. It remains to show that 

(27) max i \Q n (t p + d n k) - Q n (t p )\ = o (n 2 c n ) 

\k\<C(2> logi)' 

a.s. with Q n (t) := Yli<i<j<n ^ 2 {X%,Xj,t). We first consider Condition 1. (strong 
mixing) and concentrate on the case (3 < 4. In the case (3 > 4. a similar calculation 
canbedone. Recall that for any random variables Y\, Y m : E (maxi = i r .. !ra \Yi\) 2 < 
Y^iLi EY t 2 and therefore 



E 



i V 

max max -r— = — \Q n (t p + d n k) - Q n (t p ) \ 

^<n<2' | fc |< C (2Mog03 2 C ™ / 



1 

< — T7T, — o E max 



-2' V|fe|<C(2Hog0« d=l 
I 2 



i 22 . max (Q2( ; - 1 )+i2( ti - 1 ) (*p + d n k) — Q 2 (i-i) +i2 {d-i) (t p )) 

t , i i— 1,...,2 



- o2(i-i) 2 ^ I'^'^E (Q 2 (i-i) +t2 (d-i) (t p + d n k) - Q 2 (i-i )+i2 {d-i) (tp)) 



2 2(/-l) c 2 i 

2 |/c|<c(2 1 io g ;)3 d=1 4=1 
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1 2 21 

- 22(i-l) c 2 1 

l-E |(/i2 PQi i X i2 , i p + <i„fc) — h 2 {Xi x , X i2 , t p )) (h 2 (X i;i ,X i4 , t p + d n k) — h 2 (X i3 , X i4 ,t p 

where we used the triangular inequality in the last step. By means of Lemma 13.81 
and the same arguments as in the proof of Lemma 2 of Yoshihara [33] , we arrive at 



E I max max — \Q n (t p + d n k) - Q n (t p ) 

V2'- 1 <n<2«| fc |< c , (2 , JogJ) J 2' ! C „ 



< T^r -i — r 12 > i« 5 (i) < » ^l 2 2 l{A -~- ] = C- 



2 4; c| \laglj ^ 2 4 ^i(log/)f (logZ)* 

As /J > |, we have that | + ^7 - ±/3 = ~ 2 P 2 +^- 2 < o and thus the second 
moments are summable. Line (|2T|) follows by the Chebyshev inequality and the 
Borel-Cantelli lemma, so Line (|18p is proved. 

Under Condition 2. (functionals of absolutely regular sequences), we have by 
Lemma [331 and YlTLi < oo, Y^i°=i < 00 

£ [ max max — !: — \Q n (t p + d n k) - Q n {t p ) I ] 

\ v 2'-i<„<2' |fe| < c(211og0 j 2' ! c „ y 

C f 2' V, ao2t ^ / \ C2'(i+^) ;2o2i _ CZ* 

-2^1 v log/J tx\ 3 V 2«Zi(logO* _ 2^-^)(log0*' 

Since 7 G (0, 1), we have that | — ^7 > and the second moments are summable. 
Line (|2"T)) follows by the Chebyshev inequality and the Borel-Cantelli lemma, so 
Line (fT8|) is proved. 

To prove Line (fl9|) . let w.l.o.g. u = 1, otherwise replacing h(x,y,t) by 
ft ^2, y, ^j-jj ■ We represent i?' n as Z^ (Z7 (t p ) — U n (t p )) with 

Z; (a:) := (U n (• + t p ) - U n (tp))- 1 (x) -x= U' 1 (x + U n (t p )) - x - t p . 
By Proposition 13. Ill 



limsupi J—^ (U n (t p ) - U (tp)) = C. 

n-j-oo V log log n 

By Line ((TH) and Condition (|T7J| 

sup \U n (x + t p ) - U n (t p ) - x\ 

\x\<Cy/ lael ° en 

< sup \U n (x + t p )-U(x + tp) - U n (t p ) + U (t p )\ 

M<cy lo8 L° 8 " 

+ sup \U (x + t p ) - U (t p ) - x\ = o(c n ) . 



M<cy losl ° sr 

Then by Theorem 1 of Vervaat [31 



\K\< sup \Z' n (x)\ = o(c n ), 

\x\<c/^^ 
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so Line (fl9|) is proved. □ 
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